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Abstract 

In this paper a general approach for the perfect simulation of a stationary process 
with at most countable state space is outlined. The process is specified through a 
kernel, prescribing the probability of each state conditional to the whole past history. 
We follow the seminal paper [CFF02 ]. where sufficient conditions for the construction 
of a certain perfect simulation algorithm have been given. We generalize this approach 
by defining backward coalescence times for these kind of processes; this allows us to 
construct perfect simulation algorithms under weaker conditions. Backward coales- 
cence times are constructed in the following ways: (i) by taking into account some 
a priori knowledge about the histories that occur; (ii) by merging the algorithm in 
|(]FFn2j with the classical CFTP algorithm |PW96] . 
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1 Introduction 

Perfect simulation algorithms for stochastic processes have been developed mostly for Markov 
chains, starting from the original CFTP algorithm presented in the founding paper by Propp 
and Wilson |PW96] . Later on, Foss and Tweedie |FT98] recognized the fundamental role 
of the so-called stochastic recursive sequences for perfect simulation. Murdoch and Green 
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|MG98j constructed a stochastic recursive sequence for perfect simulation when the transi- 
tion kernel satisfies a minorization condition, called the gamma-coupler. Among the appli- 
cations of perfect simulation in recent years, we cite stochastic geometry f |FFG02j . |M0lOin 
and random fields f jHSOO] . |DSP08j l 

The fact that the main idea underlying stochastic recursive sequences, and the gamma- 
coupler in particular, works beyond the markovian case, is shown by the extension, due to 
Comets et al |CFF02j , to processes with infinite memory. The aim of the present work is to 
present some generalizations of their results. 

In this paper we consider stochastic processes defined on Z with values in an alphabet G, 
which is finite or countable: thus realizations of these processes are two-sided infinite words. 
The law of the process is obtained through a transition kernel prescribing the probability 
that each letter of the alphabet occurs in any given position of the word, conditional to the 
whole history preceding it. 

For notational convenience we use the following convention concerning sequences with 
values in G: whenever m < n are elements of Z we define the word 

a"- — ( Q Q ^ a n^-n+i 

^rn \'^ni ■ ■ ■ i •^m) ~ ^ 

With an obvious extension we also allow m = — oo and n = +00. For brevity of notation we 
write s := st^. For m = —00 and n finite the word will be called a history. Histories are 
elements of G~^ , where N* is the set of positive integers. We can concatenate any word 
with a history w™^^, obtaining another history 

(C) W!?^^) = . . . , S™, Wm-U Wm-2, • • •)• 

The same notational conventions are used for sequences with values in the interval [0, 1). 
The set of histories G"^* is equipped with the ultrametric distance 

5(s:L,t:L) = 2— s:L,t:L e g-^*. 

The corresponding Borel a-algebra coincides with the product a-algebra, which is generated 
by all cylinder sets. 

Let us consider a kernel p : G x G^^' — t- [0,1], which will be denoted by p(5'|wl^). 
This means that, for any g E G, p{g\-) is a measurable function in G~^ such that 

We say that a process n G Z} is compatible with the kernel p, if for any m G Z and 
geG 

P{Xm = g\Xm-^,^eN*)=pig\X^_!^'), a.s. (1) 
For any n G N_|_, the "one-dimensional" kernel p induces an (n + l)-dimensional kernel 
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p(n+i) . Qn+1 X ^-N+ ^ [0, 1] defined by 

n 

P^''"^^n^n,...,^o|wZ^) = JJp(^fc|^fc_i,...,^o,wZ;^), Qk^G, A; = 0, l,...,n, wZ;^ G G"^" 

fc=0 

(2) 

If tlie process ri G Z} is compatible witli p, tlien for any m G Z, n G N and any choice 
of ^ffc G G, = 0, n 

n 
fc=0 

Starting from a kernel p, perfect simulation is aimed to construct algorithms for sampling 
a compatible process {X„,nG Z}, giving at the same time sufficient conditions for its 
uniqueness. 

Processes of this type are known in the literature as random systems with complete 
connections: for the foundations of their theory see |IG90] , whereas for a full account about 
the literature on these processes we refer to the introduction in |CFF02j . In particular, 
previously known uniqueness conditions were given in [Ber87j and |LalOOj . 

We conclude this introduction by giving a plan of the paper. In Section 2 we introduce 
general coupling functions in the context of processes with infinite memory and define 
a general backward coalescence time. Its existence allows to deduce perfect simulation 
algorithms for the unique stationary process compatible with the kernel. At the end of the 
section the "maximal" coupling function is described, as introduced in |CFF02j . 

From the nature of the backward coalescence time used in |CFF02j we abstract the notion 
of information depth, to which Section [3] is devoted. This is a stopping time, associated 
to each instant and adapted to the past values of the random sources feeding the coupling 
function, which bounds the amount of information needed on the previous states in order to 
compute the state at that instant. From an information depth we give a canonical way to 
construct a backward coalescence time, provided it can be shown that it is a.s. finite. As in 
|CFF02j . under slightly stronger condition, there is also a regeneration structure, which can 
be exploited to simulate the process for all positive times and not just on a finite window. 

In Section 4 we modify the information depth used in |CFF02] in order to deal with 
examples like alternating renewal process and more general processes with a random change 
of regime in the memory of the past, for which the algorithm in |CFF02j is not successful. 
The main ingredient for proving that our modification works is the knowledge of the histories 
that could occur, once the sources of randomness are produced backward in time. 

Finally, in Section 5 we construct directly a backward coalescence time, when the in- 
formation depth in |CFF02j is always strictly positive, denying the possibility of building 
from it a backward coalescence time. In general, the construction of this modified backward 
coalescence times needs the modification of the coupling function as well. The construction 
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also requires a positive probability of coalescence in what we call the markovian regime: 
under suitable conditions, a perfect simulation algorithm is constructed by combining the 
algorithm in |CFF02] with the classical CFTP in |PW96j . A class of examples in which 
these conditions hold is finally discussed. 

2 Coupling functions, backward coalescence times and 
perfect simulation 

In this section we discuss some general issues involved in the design of a perfect simulation 
algorithm for a process compatible with a kernel p : G x G~^* — )■ [0, 1] of the form described 
above. The first concept to be introduced is that of coupling function. Despite the fact that 
in all the examples presented throughout the paper the coupling function is almost always 
the same, borrowed from |CFF02] . we believe that it is useful to give an abstract definition. 
In particular we choose to make explicit the dependence of the backward coalescence time, 
which is defined afterwards, on the coupling function. In fact, several backward coalescence 
times will be discussed throughout the paper, different from the one used in |CFF02j . for 
the same coupling function. 

We first give the definition of admissible history, which is related to the zeros of the 
kernel function. This concept will be useful in the definitions and the results that follow. 

We start with the definition of a forbidden word of the alphabet G, recursively on the 
length. A letter g of the alphabet G is forbidden if p(fi'|wZ^) = 0, for any wZ^ G G^^* . A 
word = (so, . . . , S-n+i, s^n) of length + 1 is forbidden if either sl^ is forbidden or 

Pisol^Zl) = 0, Vwl^ G G-^* : wl^ = sl^. 

For any n G N+, we call Tin the set of words that are not forbidden, of length n. 
Next define the set of admissible histories 

U = {wZl^ G G-^+ : wZ^ eHn,ne N+}. 

Since the set of histories wZ^ G G^^* such that wZ^ = sZ^'i for any fixed sZ^ G G'^~^^ is 
closed, the set "H, being an intersection of sets of this form, is closed. 

Now we prove that a process X, which is compatible with p, is such that X° ^ belongs to 
"H with probability 1. It is readily seen that it is enough to prove that if is a forbidden 
word for p, then 

P(Xo = So,...,X_„ = s_„,)=0. (4) 
In order to prove this, notice that by the definition of forbidden word and ([2]) it is 

p("+i)(so,...,s_.|wZr') = 0, 
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for any wZ^^ G G^^* . By integrating over wZ^^ with respect to the law of the process 
we conclude that (jl]) holds. With exactly the same argument it is proved that X™^^ belongs 
to T-L w.p. 1 as well, for any m G Z. 

In principle, the construction of the set of admissible histories can be iterated, replacing 
in the above definitions G~^+ with "H. In this way the set of forbidden words could be 
enlarged, and thus the set of admissible histories could be reduced, and so on. We choose 
not to pursue this kind of generalization, since the previous definition is adequate for the 
examples which will be presented during the paper. 

A coupling function f for the kernel p is a function / : [0, 1) x H — t- G such that 
for any wZ;^ G and any g G G the set {u G [0, 1) : /(m|wZ^) = g} is a disjoint 
union of intervals [cj((y'|wZ^), '^i(5'|wZ^)), i G N+, of total length p {glwZlo). For practical 
simulation purposes we also assume that Ci{g\wZlo) and di(g\wZlo) can be computed by 
looking at a finite portion of the history wZ^. This implies that / is jointly measurable 
and for any u G [0, 1) the function f{u\-) is continuous in "H. 

Since an interval [c, d) is either empty or it has positive length, the set of admissible 
histories is invariant under the coupling function, in the sense that for any u G [0, 1) 

wzlen^{fiu\wzl),wzl)en. 

As a consequence of the definition, if / is a coupling function for p and f/ is a random 
variable uniformly distributed in [0, 1), then 

P{fiU\wZl) =g)=p [gWzlo) , for each g G G, wZ^ G H. (5) 

Starting from f^^^ = /, we define recursively f^"'^ : [0, 1)" x T-L ^ G for any n G N, in 
the following natural way 

/(«+i)K,...,«o|wZL) := / Kl/(") K_i,...,«o|wZL) .•••./^'n«o|wZL),wZL) • (6) 

Thus, whenever Uk,k = 0,...,n are i.i.d. random variables with the uniform distribution 
in [0, 1), the random vector {f^'^'^^^Uk, f/o|wZ^), k = 0, ...,n) has the law given in 

([2]), for any wZ^ G "H. This means that through the iterations of the coupling function it is 
possible to define, in the same probability space, a family of processes evolving in forward 
time according to the given kernel p, indexed by all admissible histories wZqo ^ ^• 

For the implementation of a perfect simulation algorithm we require a coupling function 
/ to admit a backward coalescence time, which we are going to define. 

Consider a sequence U = {f/j, z G Z} of i.i.d. random variables, with uniform distribution 
in the interval [0, 1), used as the source of randomness for the construction of the processes 
of interest. For any m, n G Z with m < n we define the cx-algebra J-"^ = a {Ui, i = m, n). 
For simplicity of notation we specify an arbitrary reference admissible history gZ^ G H. We 
say that a measurable function ro(U° ^o) with non positive values is a backward coalescence 
time if it has the properties: 
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HI. —To is an a.s. finite stopping time w.r.t. the filtration {J^\ : n G N}, i.e. {tq = 

-/} G J^^i for any / G N; 

H2. if To = — /, tlien for any w_^"^^'' G "H 

f^'\Uo,u.„...,u.,\w-_i^'^) = /('+^)(f/o,t/_i,...,f/_dg:r^ (7) 

Tlie meaning of this definition is that by pushing back the initial time until tq, which is 
computable by simulating, backward in time, the sequence {Uq, f/_i, . . .}, the dependence 
of the value of the coupling function at time on the history prior to time tq vanishes: only 
the dependence on {Uq, U-i, . . . , Uro} remains. It is readily seen that property H2 remains 
true for tq > —1. 

Likewise we can repeat the same construction for any n G Z, defining 

r„(U^J:=n + ro(U'!J,VnGZ. (8) 

If Tq is a.s. finite, r„ is finite as well, by translation invariance. For further use, for m < n, 
we also define 

T[m,n] = mi{Tm,Tra+l, . . . ,Tn-l,Tn}, TJl < U. (9) 

If To is a backward coalescence time we define the process X = {X„, n G Z} as 

Xn = 5^/('+^)(t^n,^n-l,...,^n-dg-;^-')lK=n-/}(U!!^). (10) 

Notice that the definition does not depend on the choice of the reference history gZ^ G "H. 

Proposition 1. If tq is a backward coalescence time, then the process X is stationary and 
it is the unique process compatible with the kernel p. 

Proof. The stationarity of X is guaranteed by construction. Let us proceed to prove that 
it is compatible with p. By stationarity it is enough to prove ([1]) for m = 0. Given the 
realization U'^^ define the non empty random subsets of "H 

In+l{Uo, ?7_i, . . . , f/_„) = 

{(/('^+^)(f/o, f/-„|w:r')), . . . , /«(f/.„|w:r')), wZ^')) : w-J--"'^ G Hh 

for ?7, G N, made of admissible histories in 7i, obtained by varying in all possible ways the 
initial history prior to time — n, and then applying the coupling function with the fixed 
values U-n, . . . , f/o, until time zero. 
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The sequence In+i{Uo, f/_i, . . . , is non increasing in n G N. Moreover each element 
in /-r[-n,o]+i(f^O) U^i, . . . , Ur[-n,o]) has ultrametric distance from X° ^ which does not exceed 
2^". Therefore X° belongs to the closure of 

hiUo) = {ifiUo\wZl),w-_l) : wZl G n}. 

But the continuity of f{u\-) implies that /i(t/o) is closed, hence X^^o ^ h{Uo), meaning 
that Xl;^ G "H and 

Xo = /(t/o|x:L). 

Since Uq is independent of J^I^ and X_„ is measurable w.r.t. this a-algebra, for any 
n G N+, this implies that X satisfies ([T]) with m = 0. The proof of uniqueness is essentially 
the same as in |CFF02j p. 935. It is a consequence of the fact that the tail probability 
P(r [0,72] < —i), gives an upper bound on the variation distance between two distributions 
of the form ([2]) indexed by any two initial histories in which differ only before time —i. 
By a.s. finiteness of r[0,n], this tail probability goes to zero as z — )■ oo. □ 

The construction of the process X yields a perfect simulation algorithm on a finite 
window n], obtained first by a backward inspection of the sequence {Un-i,i G N) in 
order to locate the stopping time r[m, n] defined in ([9]), and then by a recursive computation 
of the coupling function started from the reference initial history gL^^'"^'"^. In general we 
cannot say that all the intermediate values of X prior to time m are identified during this 
computation, but this will happen for the kind of backward coalescence times considered in 
the next section. 

Mimicking the proof of Proposition [1] we can construct the process X also when the set 
of admissible histories "H is replaced by a possibly smaller subset Ti' in the definition of the 
coupling function / and the backward coalescence time tq. 

Proposition 2. Suppose that: 

1. T-L' is invariant under the coupling function and under the cut operator sending wZ;^ 
into wZlo,- 

2. for any u G [0, 1), the function f{u\-) is continuous in Ti' ; 

3. X G "H' with probability 1; 

4- any P compatible with the kernel p gives probability 1 to H' . 

Then, if tq satisfies the assumptions HI and H2 ( with 1-L replaced by %' ), the process X is 
stationary and it is the unique process compatible with the kernel p. 
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Finally we present the construction of the "maximal" coupling function introduced in 
|CFF02j . modified by taking into account only the trajectories in the admissible set of 
histories "H. In order to present this coupling function some relevant quantities have to be 
defined. First define : G x "H — > [0, 1] as 

ao{g) = inf {p{g\zZl^) : zl^ G , g eG, 

a,{g\w-_l)=mf{pig\zZl):zZlen,z-_l = w-_l}, g E G, wzl E (11) 
and the increments 6^ : G x "H — )• [0, 1] defined as 

h {g\^Zl) = akig\wZl) - ak-i{g\wzlk_i)) , 

for any G N, with a_i = . 

In order to define the maximal coupling function we need to assume that, for any g E G, 
the function wZ^ E H ^ pig\^Zl) is continuous, i.e. 

n 

Y,h{g\^Zl) = an{g,wzl)^p{g\wzl), ^g E G, wzl E H. (12) 

fc=i 

Also define, for any wZ^ E H and A; G N 

ak (wZ^) := J2 «fc {al^-D ■ (13) 

It is easily proved that (fT2!) is equivalent to 

{wZl) t 1, VwzL G n. (14) 

Next we partition the interval [ak^i{wZl^i), ak{wZl)) in subintervals BkiglwZl) of length 
bk {g\^Zk) (if this value is positive), varying g E G, for any /c G N: in the union U^gSfc((?| wZ^) 
the function /(m|wZ,^) takes the value g. Any function of this form will be called a maximal 
coupling function. 

Also in the definition of the maximal coupling function it is possible to replace the set 
"H with a smaller set "H', provided the assumptions of Proposition [2] are satisfied. We will 
see a particular example in the sequel. 

3 Backward coalescence times constructed from infor- 
mation depths 

In this section we present a particular class of backward coalescence times specified through a 
two-stage procedure. This concept is inspired by the particular construction of the backward 
coalescence time presented in [CFF02] . 
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An information depth Kq = Kq{\J'^^) for the coupling function / is an a.s. finite 
stopping time w.r.t. the filtration n G N} with the property that Kq = m implies 



/(™+i)(f/o,f/_i,...,f/_„jw:(r+^) 



for any m G N and any w.^^"*^^ G V., such that 

(/(™)(f/_i, ^_|w:(r+^)), /(^Hf^-r^lwi^T-'^^ g:^""^^) e n. (le) 

It is checked that when this is fulfilled it remains true for any m > Kq. In fact the set of 
equalities ffT51) which have to be checked, for a fixed wZ;^ G "H, is reduced as m grows. We 
recall that gZ^ G "H is arbitrary, so if m > f^o, the dependence of the coupling function 

/("^"'"-'^^(f/o? f^-i) • • • 7 f^-mlwZ^^"*^^), on the history wZ^"*""*^^ G "H prior to time — m, is due 
only to the states computed in the subsequent interval [— m, —1]. For m = property f|T5l) 
means that /(t^|wZ^) is constant w.r.t. \<rZ\o G l-L. 

By comparing f|T5|) with ([7j) it is seen that Kq is not necessarily the negative of a backward 
coalescence time. In general, to eliminate completely the dependence on wZ^^^^ G 7^ in 
fllSp . a larger value of m has to be expected. In order to construct a backward coalescence 
time we define the sequence 

K = {i^,=A-o(UZJ,jGZ}, (17) 

of information depths at all times. Next introduce the random variable 

rfi^U = sup {s < : K, < j - s, s < j < 0} . (18) 

Notice that, differently from Kq, takes negative values: indeed, by definition < ~Kq. 
The random variable is a candidate for a backward coalescence time; in fact the following 
result holds. 

Proposition 3. If is a.s. finite it satisfies properties HI and H2. 
Proof. Let us observe that, for any m G N, 

{-rf <m} = UZoF., (19) 

where 

F, = {K^, = 0, < 1, . . . , < ^ - 1, < 2}. (20) 

Since Fi G HI is proved. 
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Now assume that Fi is realized, for some z G N. From K_i = it is obtained that 
imphes 

/(t/-.|w:i+^^) = /(f/-.|g:!:^'^), (21) 

for any wl^"^^^ G and thus 

for any wZ;^ G l-i. Using -ft'-j+i < 1 and ( fTSl) we obtain that 

/(f/-ml/(f/-.|w:r^g:r^) = /(f/-ml/(f/-.|w:r^w:(^+^)) = /(^)(f/_,+i,f/_,|w:r^ 

By induction, using the same argument, it is obtained that 

/»([/o, . . . , f/_.+i, f/_.|w:J^+^)) = /»(f/o, . . . , f/_.+i, f/-.|g:J^+'^ (22) 

for any w_^^^'' G "H. Since —t^ < m means that Fi is reahzed for some i G [0,m] and the 
property (!22|) is preserved for values larger than i, we get that H2 is fulfilled, too. □ 

Under the assumption of Proposition [3] we can define the process X through and 
(fTOj) . with the shifted backward coalescence times defined by 

Tn = T^ = sup{s <n:Kj<j-s,s<j< n}, (23) 

for any n G Z. Since m G [t;^",''^] implies > t^, by starting the forward simulation 
from time r^, it is possible to recover all the values Xm, with m = t^, . . . ,n, through the 
iteration of the coupling function with the (arbitrary) initial history gL^ocT^- 

Next we introduce a property which is stronger than the a.s. finiteness of t^, but easier 
to verify; this is again suggested by |CFF02] . In order to introduce it, define the event 

_ > Vn G N} = {r^[0, oo] = 0}, 

where r^[0, oo] = inf{r/^ : i>0}. belongs to the a-algebra J'q'^ = a(U„6N^o )• When 
is realized the iteration of the coupling function, started at time from the arbitrarily 
chosen history gZlo G "H, produces X„ for any n G N. 

It is convenient to rephrase the event in terms of the information depths {Kn, n G N}. 
This is done in the following simple lemma, which is essentially borrowed from [CFF02] . 

Lemma 1. The following identity holds 

R^ = {Kn<n,n e'N}. (24) 
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Proof. First we prove that is included in the r.h.s. of f l2^ . Observe that, for any n G N, 
it is Kj < j — for j G [T^,n]; in particular, for j = n, Kn < n — t^. This does not 
exceed n provided > 0, which proves the promised inclusion. For the converse inclusion 
the argument is the following. If Kn < n for any n G N, then it is seen from ( 123|) that 
belongs to the set whose supremum is precisely t^. Thus > 0, for any n G N. □ 

Proposition 4. If P(R^) > then r^[0, oo] is finite a.s. 

Proof. Define the sequence of events {R^,m G Z} as 

= {r^+n >m,neN} = {Km+i <lje N}. 

Without loss of generality, working with the canonical realization of the process U, we can 
identify R^, for any m G Z, as an event of the sequence space [0, 1)'^ . Then R^ = a"^{R^), 
where a is the forward unit shift on the sequence space [0, 1)^. By using the ergodic 
theorem it is deduced that there exists an a.s. finite Yq < such that Ry^ is realized. Since 
> r^[0, oo] > r^[lo) oo] = Yq, the former is a.s. finite. □ 

If P{R^) > 0, along the same lines of the proof of Corollary 4.3 in |CFF02] , it is possible 
to prove also that ^^gz ^^r^ ^ stationary renewal process. 

In principle, by starting the computation of the coupling function at time Yq (from the 
arbitrarily chosen history g^^^), we can construct the process X„ for all times n > Yq. 
However notice that, —Yq being a stopping time w.r.t. the filtration {J^^!^]m G N}, it is 
not accessible by simulation. 

We finally describe the construction in |CFF02j of an information depth for the maximal 
coupling function given in the previous section, with the adjustment needed to take into 
account its dependence on the admissible histories. Let us define 

ak = inf [ak (wl^) : wZ^ G , k e N+, 

where ak (wl^) has been defined in f|T3|) . and assume that the non decreasing sequence 
{ofc, k G N} tends to 1, as A; — )■ oo. This guarantees that [ak{g\wZl) , k G N} converges to 
p(5'|wZ^), for any wl^ G H and any g E G, as k oo: by consequence the maximal 
coupling function /(-IwZ^) is well defined for any wZ;!„ G Ti. Next define K : [0, 1) — j- N 
as 

oo 

K{u) = J2 ^l[afe-i,afe)(«) = inf{A; G N : > n} (25) 

k=0 

where a_i = 0. Since ak < afc(wZfc), for any wZ^ G Ti, if K{u) = k, the coupling function 
f{u\wZlo) is computable by knowing only wz].. Thus if 1, as /c — )■ oo, condition f|T5l) 
holds for Ko = K{Uo), hence K{Uq) is an information depth. 

Sufficient conditions on the sequence {a^, k G N} which guarantee that the stopping 
times and r^[0, oo] (with Kj = K{Uj)), are finite a.s., can be found in [CFF02j . We 
summarize the main results in the following proposition. 
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Proposition 5. Let {Ui,i G — N} be a sequence of i.i.d. random variables, uniformly dis- 
tributed in the interval [0,1), and let {a^ € [0,1], A; G N} be a sequence increasing to 1. 
Define K as in l[2^) . 



k 

(a) If'Yl^=Q n '^i ~ ^ (which implies ^ 1? as k ^ oo), then 

j=0 



Tq = sup {s < : K{Uj) < j - s, s < j < 0} > -oo, a.s. 

oo 

(b) // n dj > 0, then P{R-k) > 0, thus 

j=0 

r^[0, oo] = sup {s < : K{Uj) < j ~ s, s < j} > — oo, a.s. 

4 An information depth depending on the whole past 

In order to motivate the present section we start witli a class of examples for which the 
sufficient conditions of Proposition |S] appear to be rather restrictive. 

Example 1. Assume G = { — 1, 1}, and consider a kernel p : G x G^^* — )■ [0, 1] of the 
following form 



Pk{w-i,j), ifw-i = ■■■ = w^k, w-k-i = -w-i, 

Poo(W-l,j), lfW-n = W-i, n > 1, 



where 

Pk = {Pkii^j) -i,] e {-1,+1}} 

is a stochastic matrix for any k G N4. U {00}. The value Pk{hj) gives the conditional 
probability that the next state is equal to j given that the previous k states are all equal to 
the current state i, and the {k+l)-th equals —i (when k < 00). Since, after the first change of 
sign, further information about the past is not relevant, it appears that pk{i,i),i G {—1, +1} 
represents the survival rates of an alternating renewal process (see IBBOSf pp. 32-35). 
We assume that there exists e > such that, for i = —1,1, it holds 

e <Pft(«,0 < 1 -e, /iGN+U{oo}. (26) 

In this case obviously % = G^'^+ ; however it is possible to consider, in the definition of 
the maximal coupling function, the smaller set of histories 

00 00 
^' = {wlL) : = +oo,^6yj_^^-i = +00}. 

i=l 1=1 
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The assumptions of PropositionlB o,re rather trivially checked. 1. holds since the occurrence 
of ^-\o G "H depends on the tail of the sequence wZ^. 2. is due to the fact that f{u\-) is 
constant on sufficiently small halls in Ti' . Finally 3. and 4- are ensured by (d^. 
Moreover 

ao(-l) = min{ inf Ph{-1, -1), 1 - sup ph{l, 1)} > e, 
ao(l) = ao - ao(-l) = min{l - sup Ph{-1, -1), inf Ph{l, 1)} > e. 
As a consequence 

M'^-oo) = SUp{n G -N : l[ao(-l),ao)(f^n)l[0,ao(-l))(f^n-l) + l[ao(-l),ao)(f^n-l)l[0,ao(-l))(^n) = 1} 

(27) 

is a.s. finite and it is readily checked to be a backward coalescence time. Applying Propo- 
sition m the existence and uniqueness of a stationary alternating renewal process is proved. 
Condition ^2M) is certainly more restrictive than needed, since it implies that the distribu- 
tions of the holding times have exponential tail bounds, whereas it is enough that they have 
finite mean, see IB BO 3^ . 

Next we check the sufficient conditions in Proposition O Since 

Ofc = 1 - max(supp/j(-l, -1) - inf Ph{-1, -1), supp,,(l, 1) - inf ph{l, 1)), k E N+, 

h>k h>k h>k 

it follows that — ?■ 1, as k ^ oo, if and only if pi^{i,i) converge as k oo, for i = —1, 1. 
If this condition fails Proposition\^ cannot be applied. Even if this condition holds, the speed 
of convergence of to 1 can be so slow that condition (a) in Proposition is still violated. 
This happens, for example, for 

Ph{z, z) = ^(^i- ^7=^) , ^ e {-1, 1}, heN+u {oo}. 

The previous example suggests to investigate alternative ways to define an information 
depth for the maximal coupling function, order for the construction of a backward coales- 
cence time under weaker assumptions than those given in Proposition [51 

Let us introduce the process {Ah, h G N}, with Aq = ao and 

AhiU.i, . . . , U.h) := inf {aniwlD : wZ;^ G A(?7_i, . . . , f/-/.)} , /i G N+, (28) 

where 

A(f/_i, ...,U-h) = {^Zl en:w.k = 9, if U-k e Bo{g), geG, k<h} (29) 

is a set of histories smaller than Ti, since the states which can be identified, given . . . , U-h, 
are kept fixed. In fact, whenever U-k G Bo{g), the function f{U-k;w_^^'^^^) is equal to g, 
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irrespectively of the previous history w_^^^^ G "H. Since Ah{U_i, . . . , is an infimum 
computed on a smaller set, it holds 

Ah{U.i,...,U^h)>ah,heN, (30) 

for any realization of the i.i.d. sample Ul^. 
Now let us define 

K'{U'_J = inf{j G N : f/o < A,(f/_i, . . . , (31) 

Proposition 6. If limh Ah{U-i, . . . ,U^h) = 1 o.s., K' is an information depth for the 
maximal coupling function. 

Proof. Only property (1T5|) needs some explanations. Suppose that K'(\J^^) = m. Then 

Uo < A^{U-i, U-ra) < a„(wZ^), VwZ^ G J™(f/-i, . . . , U-m), 

which from the definition of the maximal coupling function implies 

/(C/o|wI^) = f{Uo\zZl,), for wZ;^, zZ^ G JmiU-i, U_^), such that wZ^ = zZ^. 

(32) 

Finally consider any w_^'''^'' G H; then, by choosing 

wz^ = (/(-Hf/-i, • • • , u^m\w-J::^\ . . . , /(^nf/-r.iw:jr^^))), 

the history wZ^ G Jm(f^-i, • • • , f^-m)- Now set zZ;!xd = (wZ^, g-^^"*^^)- If zZ;'» G V. then it 
belongs necessarily to Jm{U-i, . . . , f/_m) , in which case formula (l32l) is turned into ( fTSl) . 

□ 

Next define {K'j = K'(lJi^),j G Z}, and Tq^' and Rf' as in ([18]) and ([21]), respectively: 
then the following result holds. 

Theorem 1. IfUZoMUh-i, • • • , ^^o)-^ G i/ien P(i?f ) > 0. 
Proof. The sequence 

11/1=0 • • • , t>Oj 

is uniformly integrable, because it is bounded by the integrable random variable YlhLo ^h{Uh-i, 
Moreover it is a martingale with respect to the filtration {J-"^ = a{Un, ■ ■ ■ , Uq) : n G N}. In 
fact, since Un is independent of J-^~^, it holds 

E (l{l/„<A„((7„-i,...,(7o)}l-^0 ~"^) = An{Un-l, ■ ■ - , Uq) , 
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hence 

nn-l ^ 
„,v , h=0 ■'-{Uh<Ah(Uh-i,...,Uo)} „ \T-n-l\_v 
^[^n\-^ ) - -yf^ TTTt tTV^ [^{U„<A„{U„-i,...,Uo)}\-^ j " -^n-l" 

Furthermore, since Yq = ao~^l^Uo<ao}, it follows that E(Yn) = E(Yo) = 1. 

Since {Yn} is uniformly integrable, from a well known result (see |Wil91] . page 134), 
the limit 1^00 := linin-s-oo Yn is finite a.s. with £'(1^00) = 1- As a consequence Y^o > with 
positive probability. But clearly 

00 

{Yoo >0} = f]{Uh< Ah{Uh.,, ...,Uo)} = {K<h,heN} = Rf, (34) 

h=0 

which ends the proof. □ 

By applying Proposition HJ the previous theorem implies that a perfect simulation algo- 
rithm can be constructed from the information depths {K'pj G Z}. 

Example 1 (continued). We prove that TheoremUl can be applied to ExampleUl under 
the assumption 

ao(— 1) > 0, ao(l) > 0, a^o '■= supa^ > 1 — 2ao(— l)ao(l)- (35) 

k>0 

Notice that the latter condition is automatically verified if the former ones hold and ago = 1- 
Define 

N(IJ^) = mi{n G N : l[ao(-l),ao)(t^n)l[0,ao(-l))(f^n-l) + 1 [ao(-l),ao) (f^n-1 ) 1 [0,ao(-l)) (f^n) = !}• 

(36) 

Then ifh> N{\]^), and w^^T^ G JhiUh-i, . . . , f/o) then 



In this case 



AhiUh-u . . . , t/o) = inf I J] aniglw^o'') ■ ^-'o^ ^ MUh^u ■ ■ ■ ,Uo)\ 

UeG J 

= inf i J2p{g\w^S^) : w^-^ G J,(^,-i, . . . , f/o 
UeG 
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Therefore, for any 5 G (0,aoo — 1 + 2ao(— l)ao(l)), choosing Uq = no{6) such that a„g > 
1 — 2ao(— l)ao(l) + ^> it is obtained 

oo N no 

(H MUh-u • • • , Uo))-' = (H MUh-u • • • , Uo))-' < (1 - 2ao(-l)ao(l) + 5)"^ J] 

h=0 h=0 h=0 

(37) 

The expression ([2^ suggests a majorization of N with twice a geometric random variable 
having the success probability p = 2ao(l)ao(— 1). Since the radius of convergence for the 
p.g.f. of this kind of random variable is 1/(1 —p) the assumption ^3^\) and the bound (3l^ 
imply that YYh=o^h{Uh-i, ■ ■ ■ ,Uo))~^ is integrable. Therefore Theorem\l\ can be applied, 
showing that the stationary alternating renewal process can be perfectly simulated. 

Inspired by the previous example, in the following corollary we present a sufficient con- 
dition, possibly easier to verify, which guarantees that the assumption in Theorem [T] holds. 

Corollary 1. Let Ch be a Borel subset of [0, 1)'' and suppose: 

1) the sequence 

ah = mi{Ah{uh-i, uq) : {uh-i, uq) G Ch} (38) 
is such that YYt^Q^h > (in particular ao = ao > 0); 

2) the random variable 

N ■= iV(U+°°) = inf {m : (f/„_i, . . . , f/o) G C„, \/n > m] (39) 
has a probability generating function E{s^) < oo for some s > 1/aoo- 

Then 

ElflAhiUH-u...,Uo)-A <oo. (40) 

\h=0 J 

Proof. By definition of N, > ah for h > N. Moreover, since Ah > ah for each integer h, 
we have 

111 

oo 7~ — „7V TTOO • (^l) 

h=0^h [[h=o^hiih=N+l(^h 

By taking expected values at both sides, with a straightforward bound for the second factor 
at the r.h.s., it is obtained 
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The second factor at the r.h.s. is finite by assumption 1). By assumption there exists an 
integer k such that l/a^ < s, s being as in 2). By consequence we have the following bound 
for the first factor 

from which the corollary follows. □ 

Finally we provide another class of models that satisfy the conditions of Corollary [1] but 
not those of Proposition |5l 

Example 2. Consider positive summahle sequences f3{i) > 'j{i), i G N+, and assume that 
Pi G (0, 1), cr > and c > are such that 

oo 

Pi(l-c^/3(z))>a; (44) 

i=l 

moreover assume that Yl'ili < 

Now define the kernel p on G = {0, 1} by 

oo 

P(l|wZL) = Pi{l - cXl(/^(^)l{«'-.=o,r(wiL)>i} + 7(^)l{^_,=o,T(wiL)<i})}' (^^) 

1=1 

where 

T(w:^) = inf|A::S^>^|. (46) 

First of all we prove that the kernel p is monotone, which means that p(l\wZlo) is increasing 
in wZlo w.r.t. the pointwise order. For this notice that W-i > rj^i, for i G N+ implies 
T(wZ^) < T{r]Zlo), hence 

oo 

P(l|w:^) > pi{l - c5^(/3(0l{^_,=O,T(wlL)>i} + 7(0l{^_,=0,T(wlL)<i}) 

i=l 

oo 

>Pl{l-C^(/3(0l{r,_,=0,T(cL)>O+^(')l{^-.=0,T(cL)<o) =P(1|^--)' 
i=l 

where the second inequality is due to the fact that > '~f{i), for i G N+. 

Since ao(l) = — cY^°li /^(O) > '^'^^ (^o{^) = 1 — Pi > it follows that Ti = G~^+ . 
As a consequence 

a.(0, w:^) = inf {p(0|w:^, zl^-i) : zZ'^' G {0, Ij'^n = p{0\wZl IZ'^') (47) 



17 



and 

a,(l,w:^) =mf{p(l|w:^,z:^-i) : zl^-i G {0, 1}-^+} = p(l|w:^, Ol^-^) (48) 

therefore 

a,(w:i.) =p(o|w:^, 11^-1) +p(i|w:^,o:^-i) = i-p(i|w:^,i:^-i)+p(i|w:^,o:^-i) (49) 

which by a direct computation is seen to assume only the values 1 — PiC Xli^fe+i 7(0> when 
T(wZ;!^) < k, and 1 — PiC Xli^fc+i '^(^)' otherwise. Notice that the condition T(wZlo) ^ ^ 
can 6e verified by looking only at wzl- 

Now we prove that this class of kernels can be perfectly simulated. In fact we can prove 
that the conditions given in Corollary\J\ are satisfied for the sequence of events 

Cn = < (m„-1, . . . ,Mo) e [0, 1)" : - ^ l{ao(0)<Mfc<ao(0)+ao{l)} > 0" • ^ (50) 

Since ao(l) > o"; from Chernoff's bound 

P((f/„_i,...,?7o)^C„)<e-^", 

for some K > therefore 



P{N < no) = P(n^=„J(t/„_i, . . . , f/o) G C4) > 1 - 5^ e-^" = ^ " 13 



n=no 



/rom which the existence of the probability generating function of N, for some s > 1, is 
deduced,. From / f37]) and the summability of /3{i), it is obtained that a^o = 1, which ensures 
that condition 2) of CorollaryU\ is satisfied. Finally observe that whenever (t/„_i, . . . , Uo) G 

Cn 



oo 
j=n+l 



A„(?7„_i,...,t/o)>inf{a„(0|w:^) + a„(l|w:^):T(w:^)<n} = l-piC 7 
therefore, by definition / f5^) . we ^'et > 1 — Pic^^„_,.i 7(«). A^'otf, ferns' 

oo oo oo 

Yl ^^'^ = Y^^^'^ < °° 

ri=0 j=7i+l j=l 

we g'et 6?/ / WiWlf . page 40, that a„ > , so i/iat condition 1) is also satisfied. 
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On the other hand, for some choices of and {7(«)}, condition a) in Proposition 

\^fails. For example consider = i"", with a G (1,2) and 7(z) = 2^', which ensure that 
Pii) > 7(^); for i G N+, and YllLi ilif) < oo. S'mce 

oo 

ak = inf {a,(w:^,) : wZ^ G {0, l}'^} = I - p,c /^(O, (51) 

i=k+l 

we can show that Y^^=i IliLi < oo. In fact 

oo k oo k / oo_.\ oo k y \ 

k=l i=l k=l i=l \ i=k+l / k=l i=l ^ ^ 

where Li > is a sufficiently small constant. The rightmost expression is smaller than 

oo fc J- oo 

E^^P(E-^) <CY.eM-L2e--) < oo 

fc=l i=l fc=l 

where C and L2 are suitable positive constants, which implies the promised inequality. 

We conclude the section by observing that the idea of defining the information depth 
by computing the infimum of a/i(wl]^) over the set J/i([/_i, . . . , U^h) of histories compatible 
with the observed f/_i, . . . , U^h can be pushed further. For example, by looking at adjacent 
pairs (t/_i, t/_j+i), i = 2, . . . , /i, it is possible to locate other states, restricting the set of 
histories compatible with the observed ?7_i, . . . , U^h to the smaller subset 

J^fZ-i, . . . , t/-h) = JhiU-i, ...,u_h)n Fn{U_^, ...,u_h), 
where Fh{U^i, . . . , U^h) is equal to 

{wl^ G U : w_k = gi,w_k+i = 92, if U^k e 50(5-1), G Bi{g2\gi), gi, 92 EG, 2 < k < h} . 

The changes to Proposition [6] and Theorem [1] are minor, but for the sake of brevity, we do 
not pursue this extension further. 

5 An algorithm which works without minorization con- 
dition 

In this section we explore the possibility of defining a backward coalescence time tq when 
qq = 0. In this case any information depth takes necessarily positive values, hence it 
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cannot be used for defining a backward coalescence time. However it is assumed ai > 0. 
Since Oi < ai{w_i) = Xlgec ""^-i ^ maximal coupling function 

f{u, wZ;^) depends only on w^i, whenever u < ai. Accordingly, we say that the simulation 
process is in the markovian regime at time n whenever f/„ < ai. This means that the 
information needed to compute the state of the process at time n concerns only the state 
at time n — 1. For any u e [0, 1) and w E G we define 

f{u\w):=f{aru\wZl), (52) 

for any choice of wZl^ E H having w^i = w. Thus / : [0, 1) x G — > G, applied to a uniform 
random variable in [0, 1), induces the Markov kernel 

M{g\w) = \{uE[0,l):f{u\w) = g}l g,w E G, (53) 

where | ■ | denote the Lebesgue measure. 

By induction, for n > 2, we define the composition /^"^ : [0, 1)" x G — ?> G as 

/(")(«„,..., ui|w) = /(u„|/("-^)(M„_i,...,Mi|ti;)), e[0, 1), t = l,...,n, wEG (54) 

where f^^^ = f. 

Concerning the markovian regime, for any n E N_|_, we define the coalescence in the 
interval [—n + 1,0] as 

En = {(Uo,M-l, • • ■,U-n+l) ^ [0, 1)" : f''"'\uo, . . . ,M_„+i|w) = /^"^Mo, • • I^-q) , Vw E G}, 

(55) 

where go E G is an arbitrary state. 

We notice that if the kernel p is markovian, then ai = 1 and conversely. In this case 
/ = / and any backward coalescence time has the property that tq = — m implies that 
(f/o, . . . , f/-m+i) e Em, as in the original CFTP algorithm |PW96j . 

Next assume that ^ 1 as — ?• oo and recall that in this case K, as defined in ( 125|) . 
takes finite values. Define the random variable Tq as 

sup{m<0:3/G [m,0], s.t. af' ([/;,..., [/J G & K([/,) < j-/, j G [/+!, 0] if / < 0}. 

(56) 

Proposition 7. // the random variable tq is finite almost surely, it is a backward coalescence 
time. 

Proof. By definition, for any m E — N, the event tq = m belongs to the cr-algebra J-"^, 
which proves HI. Moreover, if this event is realized the process is in the markovian regime 
from time m to some larger time / in which coalescence has taken place. This means that 

j{l-m+l) fEi^ _ _ = f{l-m+l) 







(-'•• 






ai J 
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for any w E G. By the relation flS^ this means that, for any w_;!^ G "H, it holds 

/('~-+^)(f/,, . . . , t/„|w:Jr+^^) = f—''\u,, . . . , f/„|g:Jr^^^) (57) 

Thus, if Z = 0, H2 holds. If / < one needs to repeat the proof of Proposition [3] replacing 
fl2T|) with fl57|) . In short, to compute all the states of the process in the interval [I + 1,0], 
there is no requirement about the states of the process prior to time /. □ 

After this result, we turn our interest to give sufficient conditions for the a.s. finiteness 

of Tq. 

Theorem 2. Under the assumptions 
(^) Er=inm=i«m = oo; 

(a) there exists s G N_|_ such that P{{Us-i, . . . , Uq) G Eg) > 0; 
To is finite a.s. 

Proof. We start by defining the sequences {Wn, n = 1,2...}, {F„, n = 1,2,...} which will 
be proved to be finite a. s. First define 

Wi = sup{m < : K{Uj) - 1 < j - m,j e [m, 0]}. 

By Proposition O part (a), condition (i) guarantees that Wi is a.s. finite: notice indeed 
that replacing K{Uj) with K{Uj) — 1 has the effect of shifting the sequence j G N} to 
the left. Next define 

Yi = inf{m < Wi : Un < ai,n e [m+1, Wi]}, Wi+i = sup{m < Yi : K{Uj)-l < j-m,j G [m, 

which are a.s. finite, for i G N+. It is immediately seen that {Wi — Yi — l}ieN+ is a 
sequence of i.i.d. geometric random variables, with success probability 1 — ai. Likewise 
{M/j+i — yj}jeN+ is a sequence of i.i.d. random variables distributed as Wi, conditional to 
be non zero. Moreover the two sequences are mutually independent and independent of Wi. 
In particular the sequence {—Wi, i G N_|_} form a delayed renewal process and the sequence 
{U^n,n G N} is regenerative w.r.t. it. 
Finally define the random index 

Q = mf{z G N+ : {Uw,_,, Uy^+i) G Ew^-y.-i} (58) 

and let r* = Yg. 

For each j G [PVj, 0] the condition j — K{Uj) > W^j — 1 is satisfied, for any i G N+. By 
consequence r* differs from tq only because the supremum is taken on the set {Yi : i G N+} 
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rather than on the whole set of negative integers. In fact notice that, for n = r* =Yq, one 
can always choose in f lSB]) I = Wq — 1. Therefore r* < tq, so it is enough to prove that 
r* > — oo a.s. But this is true because, by assumption (ii), the condition at the r.h.s. of 
(158|) is fulfilled with positive probability in any regenerating cycle: an application of the law 
of large numbers concludes the proof. 

□ 

In the previous theorem we have not assumed that oq = 0. However, in this case the 
result does not add anything to the statement (a) in Proposition |5l Indeed, if Uq is uniformly 
distributed in [0, 1), P{Uo G Ei) > if Oq > 0: assumption (ii) is always satisfied. Therefore, 
in the following we will always take = 0. 

Assumption (ii) in the previous theorem states that the markovian coupling function / 
defined in fl52|) is successful for the perfect simulation of the Markov chain with kernel M 
given in fl53|) . in the sense that backward coalescence occurs with probability 1. Since this 
implies the convergence in law of the chain as time increases, it is necessary that M has a 
single positive recurrent irreducible class which is aperiodic. 

When G is finite, which is assumed from now on, this condition can be directly referred to 
the oriented graph induced by M. Notice that if {w, g) is an arc of this graph then necessarily 
ai{g\w) > 0. However the converse is not true. In fact if Bi{g\w) is non empty and it is 
disjoint from [0, Oi) then {w, g) is not an arc. In this case, if wZ^ is such that w_i = w, the 
maximal coupling function can be replaced by a new coupling function /(m|wZ;^) which is 
different only for u < ai{w). Each interval Bi{h\w) is replaced by the union of two disjoint 
intervals B\{h\w) and Bl{h\w), where /(-Iwl^) takes the value h. 

We require that 

\B\{h\w)\ + \Bl{h\w)\ = \BMw)\ = a^{h\w) = \{u < a,{w) : f{u\wZl) = h}\ (59) 

and Bl[h\w) intersects the interval [0,ai). Therefore the Markov kernel M induced by / 
satisfies 

ai{g\w) > ^ M{g\w) > 0. (60) 

However, backward coalescence w.p. 1 cannot be ensured only by properties of the 
Markov kernel, without reference to the coupling function. A simple counterexample is 
presented in Hag02| . But when the state space is finite, there is a universal modifica- 



tion of a Markov coupling function, which ensures backward coalescence w.p. 1 under the 
only assumption that the induced kernel has a unique irreducible class which is aperiodic 
(see Proposition 8.1 p. 122 in |AG07] ). The modification consists in letting the different 
trajectories move independently before merging. 

This is more clearly explained by allowing coupling functions to depend on n+1 variables 
(m°, . . . , m") G [0, l)""*"^, rather than a single variable u G [0, 1); in the definition just replace 
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intervals by hypercubes or more general Borel sets. The modified coupling function / 
introduced before is replaced by / : [0, 1)1*^1+^ x H — > G, defined as 

fin ,u^,g E G|w_) = | ^-(^^^_,|^_^^^ < ^ g'. ^^^^ 

which is not difficult to check that remains a coupling function for p. As a corollary to 
Theorem by collecting together the two previous remarks, we can construct a backward 
coalescence time (and thus a perfect simulation algorithm) for some interesting class of 
kernels p. Notice that the last condition in the following corollary has the purpose of 
ensuring that Oq = 0. 

Corollary 2. Suppose that p : G x G^'^+ — t- [0, 1] is a kernel on the finite state space G. 
Define the oriented graph Q with set of vertices G and the set of arcs A = {{w,g) G G^ : 
ai{g\w) > 0}. Suppose 

(^) Er=inm=i«m = oo; 

(ii) Q has a single irreducible class which is aperiodic; 
(Hi) for any g eG, there exists w EG such that {w,g) ^ A. 

Then it is possible to construct a backward coalescence time for the coupling function f . 

Example 3. The previous result covers some generalized random walks on a finite directed 
graph Q = {G,A). Before defining this kind of processes, we define the set of one-sided 
infinite paths in Q 

C = {wZ^ G 6*-^+ : {w.^k+i),w^k) eA,ke N+}. 

Generalized random walks on Q = {G, A) are processes compatible with a kernel p over the 
alphabet G with the properties: 

• if {g,w) ^ A then, for all wl^ G G~^+ with W-i = w, p{g\wZlo) = 0; 

• if {g,w) G A, there exists e > s.t. for all wZ^ G C with w^i = w, p(fi'|wZ^) > e. 

The first property implies that T-L G C, whereas the second ensures the opposite inclusion. 
Moreover 

ai{g\w) = inf {pig\wZlo) ■ wZ;^ eC,w^i = w} > e> 0, 

if {g,w) E A is an arc of Q , otherwise it is clearly ai{g\w) = 0. Thus we can get the 
set A from the kernel p as indicated in Corollary [3 Therefore if the graph Q satisfies 
conditions (ii) and (Hi) and the sequence {ak,k E N_|_} satisfies condition (i), the previous 
Corollary allows to prove the existence and uniqueness of the generalized random walk, and 
the feasibility of a perfect simulation algorithm for sampling it. 
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The result of this section can be extended to cover the case ai = ■ ■ ■ = = 0, a^+i > 0, 
for some / > 1. In this case the maximal coupling function depends on at least / + 1 
variables hence it induces a markovian kernel M on the state space G'"*"^. The changes to 
the statement of Theorem [2] are rather straightforward. 
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